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(54) A method for enhancing the edge contrast of a digital image independently from the texture 



(57) A method is described for enhancing a digital 
image channel, particularly where the digital image 
channel is split into pedestal and texture signals that 
substantially comprise the digital image channel. The 
method utilizes a predetermined tone scale conversion 
to enhance the digital image channel. Initially, image val- 
ues are provided from the pedestal signal correspond- 
ing to image pixels from a region of the image. Then, a 
statistical characteristic of the image pixels in the region 



is identified, and the predetermined tone scale conver- 
sion is normalized for the statistical characteristic in or- 
der to generate a normalized tone scale conversion. The 
normalized tone scale conversion is then performed on 
a central pixel of the region in order to generate a ped- 
estal signal with enhanced image values; and the ped- 
estal signal with enhanced image values is combined 
with the texture signal to generate an enhanced digital 
image channel. 
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Description 

FIELD OF THE INVENTION 

5 [0001] The invention relates generally to the field of digital image processing and, more particularly, to a method for 
enhancing the edge contrast and texture of a digital image. 

BACKGROUND OF THE INVENTION 

10 [0002] Traditional methods of increasing the apparent sharpness of a digital image, such as the technique of unsharp 
masking, often produce unwanted artifacts at large transition edges in the image. For example, unsharp masking is 
often described by the equation: 

15 Sproc = Sorg+B(Sorg-Sus) 

where Sproc represents the processed image signal in which the high frequency components have been amplified, 
Sorg represents the original image signal, Sus represents the unsharp image signal, typically a smoothed image signal 
obtained by filtering the original image, and B represents the high frequency emphasis coefficient. 

20 [0003] The unsharp masking operation may be modeled as a linear system. Thus, the magnitude of any frequency 
in Sproc is directly dependent upon the magnitude of that frequency in the Sorg image signal. As a consequence of 
this superposition principle, large edges in the Sorg image signal will often display a ringing artifact in the Sproc signal 
when the desired level of high frequency enhancement has been performed in other areas of the Sproc signal. This 
ringing artifact appears as a light or dark outline around the large edge, and may be visually objectionable. 

25 [0004] Many non-linear filters based on local statistics exist for the purposes of noise reduction, sharpening, and 
contrast adjustment. For example, the median filter is well known in the art. In this filter, typically implemented for noise 
reduction, each pixel is replaced with the median value of some surrounding neighborhood. This filtering process is 
generally very successful at removing impulse noise; however, the processed image appears slightly less sharp than 
the original. 

30 [0005] Another example of a non-linear filter based on local statistics is local histogram equalization, referred to as 
adaptive histogram modification by William Pratt on pages 278 - 284 of the book Digital Image Processing, Second 
Edition, John Wiley & Sons, 1991 . With this filter, the values of pixels are modified by the cumulative histogram of a 
local window. This technique effectively adjusts the contrast of each region of a digital image, effectively increasing 
the local contrast in some regions of the image, and decreasing the contrast in other regions. This technique does not 

35 intend to increase the apparent sharpness of any given region. Also, this technique does not ensure that the typical 
artifacts of ringing will not occur. 

[0006] There exist many algorithms for sharpening the appearance of images without generating artifacts or enhanc- 
ing the notability of noise. In U.S. Patent 4,571 ,635, Mahmoodi and Nelson teach the method of deriving an emphasis 
coefficient B that is used to scale the high frequency information of the digital image depending upon the standard 
40 deviation of image pixel values in a local neighborhood. In addition, in U.S. Patent 5,081 ,692, Kwon and Liang teach 
that the emphasis coefficient B is based upon a center weighted variance calculation. However, neither use separate 
strategies for texture and edge regions. 

[0007] In U.S. Patent 4,794,531 , Morishita et al teaches a method of generating the unsharp image with a filter whose 
weights on neighboring pixels are based upon the absolute difference between the central pixel and the neighboring 
45 pixel. Morishita claims that this method effectively reduces artifacts seen at the edges of a sharpened image (as com- 
pared with traditional unsharp masking). However, the method of Morishita does not offer explicit control over the 
amount of edge reshaping. 

[0008] Thus, there exists a need for an alternative method of manipulating a digital image in order to generate an 
image signal that appears to be sharper, or more in focus, while minimizing the ringing artifact that is evident with the 
so unsharp masking technique. 

SUMMARY OF THE INVENTION 

[0009] It is an object of this invention to allow for independent control of the enhancement applied to detail, large 
55 edges, and noisy regions. 

[001 0] The present invention is directed to overcoming one or more of the problems set forth above. Briefly summa- 
rized, according to one aspect of the present invention, the invention resides in a method for enhancing a digital image 
channel comprised of a plurality of image pixels, particularly where the digital image channel is split into first and second 
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signals, such as pedestal and texture signals, that substantially comprise the digital image channel. The method in- 
volves utilizing a predetermined tone scale conversion to enhance the digital image channel. Initially, image values are 
provided from the first signal, e.g., the pedestal signal, corresponding to image pixels from a region of the image. Ttien, 
a statistical characteristic of the image pixels in the region is identified, and the predetermined tone scale conversion 
5 is normalized for the statistical characteristic in order to generate a normalized tone scale conversion. The normalized 
tone scale conversion is then performed on a central pixel of the region in order to generate a first signal with enhanced 
image values; and the first signal with enhanced image values is combined with the second signal to generate an 
enhanced digital image channel. 

[0011] The present invention has the advantage of controlling the value of the central pixel in the pedestal signal in 
10 accordance with a statistical characteristic of the region, e.g., driving the value of the central pixel either toward the 
local maximum or the local minimum of the region, except in the case wtiere the central pixel is substantially midway 
between the local maximum and the local minimum. Consequently, edge transitions in the pedestal signal occur over 
a narrower range of pixels than in the input image, thus when combined with the texture signal generating an image 
signal that appears to be sharper, or more in focus, than the original image. Moreover, since the output of the tone 
is scale conversion is modified by the statistical characteristic, e.g. , bounded by the local maximum and the local minimum 
of the region, systematic overshoot and undershoot at an edge boundary is diminished and the ringing artifact is not 
as noticeable. 

[0012] These and other aspects, objects, features and advantages of the present invention will be more clearly 
understood and appreciated from a review of the following detailed description of the preferred embodiments and 
20 appended claims, and by reference to the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0013] Fig. 1 is a block diagram illustrating an overview of the present invention. 

25 [0014] Fig. 2 is a block diagram of a preferred embodiment of the invention, showing the preference sharpener in 
Fig. 1 in more detail. 

[0015] Fig. 3 is a block diagram of a first embodiment of the sharpening processor shown in Fig. 2. 

[0016] Fig. 4 is a block diagram of a second embodiment of the sharpening processor shown in Fig. 2. 

[0017] Fig. 5 is a block diagram of a first embodiment of the pedestal splitter shown in Fig. 3. 

30 [0018] Fig. 5A is a block diagram of a second embodiment of the pedestal splitter shown in Fig. 3. 

[0019] Fig. 6 is a block diagram of the avoidance signal generator shown in Fig. 5. 

[0020] Fig. 7 is n example of an artifact avoidance function applied by the avoidance signal generator shown in Fig. 6. 

[0021 ] Fig. 8 is a block diagram of the pedestal modifier shown in Fig. 3. 

[0022] Fig. 9 is an example of a portion of an image showing a central pixel and the associated local region of the 
35 image. 

[0023] Fig. 1 0 is an example of several tone scale functions. 

[0024] Fig. 11 is a block diagram of the texture modifier shown in Fig. 3. 

[0025] Fig. 12 is a block diagram of a first embodiment of the local SNR estimator shown in Fig. 11 . 

[0026] Fig. 13 is a block diagram of a second embodiment of the local SNR estimator shown in Fig. 11 . 

40 [0027] Fig. 1 4 is a plot of a function used to generate a noise table. 

: . [0028] Fig. 15 is a plot of a look up table (LUT) used by the gain determiner shown in Fig. 11 . 

\ DETAILED DESCRIPTION OF THE INVENTION 

45 r [0029] In the following description, the present invention will be described as a method implemented as a software 
program. Those skilled in the art will readily recognize that the equivalent of such software may also be constructed 
in hardware. Because image enhancement algorithms and methods are well known, the present description will be 
directed in particular to algorithm and method steps forming part of, or cooperating more directly with, the method in 
accordance with the present invention. Other parts of such algorithms and methods, and hardware and/or software for 

so producing and otherwise processing the image signals, not specifically shown or described herein may be selected 
from such materials, components and elements known in the art. Given the description as set forth in the following 
specification, all software implementation thereof is conventional and within the ordinary skill in such arts. 
[0030] It is instructive to note that the present invention utilizes a digital image which is typically a two-dimensional 
array of red, green, and blue pixel values or of single monochrome pixel values corresponding to light intensities. In 

55 addition, the preferred embodiment is described with reference to an image of 1024 rows of pixels and 1536 lines of 
pixels, although those skilled in the art will recognize that digital images of different resolutions and dimensions may 
be used with equal, or at least acceptable, success. With regard to matters of nomenclature, the value of a pixel of a 
digital image located at coordinates (x,y), referring to the row and the column of the digital image, shall herein 
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comprise a triad of values [r(x,y), g(x,y), b(x,y)] respectively referring to the values of the red, green and blue digital 
image channels at location (x,y). In this regard, a digital image may be considered as comprising a certain number of 
digital image channels. In the case of a digital image comprising red, green and blue two-dimensional arrays, the image 
comprises three channels, namely, red, green and blue channels. Additionally, a luminance channel n may be formed 

5 from the color signals. The value of a pixel of a digital image channel n located at coordinates (x,y), referring to the X th 
row and the y* 7 column of the digital image channel, shall herein be a single value referred to as n(x,y). 
[0031] Referring to the overview of the invention shown In Fig. 1 , a digital image is input to a preference sharpener 
2, which sharpens the input digital image for the preference of an operator. The purpose of the preference sharpener 
2 is to enhance the detail present in the digital image without enhancing noise or creating artifacts. This purpose is 

10 accomplished by a process that decomposes a digital image channel into a signal corresponding to the image detail, 
a signal corresponding to the image edges, and a signal corresponding to the image signal to noise ratio (SNR), as 
will be described in detail hereinbelow. This decomposition and creation of separate signals allows for independent 
control of the enhancement applied to detail, large edges, and noisy regions. The output of the preference sharpener 
2 comprises a digital image that, in accordance with the invention, appears sharper and more natural than can be 

15 achieved with traditional means of sharpening a digital image. 

[0032] Fig. 2 shows a block diagram of the preference sharpener 2. The digital color image and noise information 
(in the form of a noise table 6) are input to the preference sharpener 2. The noise information is input in the form of a 
luminance table. The digital image is input to a luminance/chrominance converter 1 0 in order to generate a luminance 
digital image channel n(x,y) and two chrominance digital image channels g(x,y) and i(x,y). The luminance digital image 

20 channel n(x,y) and the luminance noise table are input over respective lines 11 a and 11 b to a sharpening processor 
20 for enhancing the digital image channel n(x,y) based on knowledge of the system noise. The transformation per- 
formed in the converter 10 from the digital color image, typically in an RGB space comprising separate red, green and 
blue image channels, to a luminance-chrominance color space is done by means of a color space matrix transformation, 
which results in the luminance digital image channel n(x,y) and the two chrominance digital image channels g(x,y) and 

25 i(x,y),as is well known in the art. In the preferred embodiment, the matrix transformation to the luminance-chrominance 
space may be described with the following equation; 
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35 

Equation A1 provides a matrix rotation from RGB space into a luminance-chrominance space in order to isolate a 
single channel upon which the tone scale function (to be described) can operate. For example, a film scanner records 
(for each pixel) the red, green and blue printing density at that point. These three values can be thought of as a pixel's 
location in three-dimensional space. The converter 1 0 performs an axis rotation as shown in equation A1 , which pro- 

40 vides for a neutral axis, upon which R = G = B, and two color difference axes, green-magenta and illuminant. 

[0033] The noise table input to the sharpening processor 20 provides the relationship between the signal intensity 
level /and the expected amount of noise a N (/) forthat intensity level. In the preferred embodiment, as will be described 
in more detail, the noise table is a two column table, wherein the first column represents an intensity level / and the 
second column represents the expected standard deviation of noise o n (/) forthat intensity level. 

45 [0034] The chrominance digital image channels g(x,y) and i(x,y) are input over a line 1 1 c to a chrominance processor 
40 and may be adjusted as desired. For instance, the action of the chrominance processor 40 may be to scale the 
chrominance image channels by a constant greater than 1.0 in order to increasetheir apparent saturation. The operation 
of the chrominance processor is not of particular relevance to the present invention, and consequently it will not be 
discussed further, except to note that, in the present embodiment, the output of the chrominance processor 40 is 

so maintained identical to its input. 

[0035] The digital image channels output from the sharpening processor 20 and the digital image channels output 
from the chrominance processor 40 are input to an RGB converter 30 for conversion back to a digital image composed 
of a red , green , and blue digital image channels. This conversion is again accomplished with a matrix rotation (i.e., 
the inverse of the previous color rotation matrix performed by the converter 1 0). Inverting a 3 by 3 matrix is well known 

55 in the art and will not be f u rther discussed. The output of the RGB converter 30 is a digital image that has been sharpened 
for the preference of the operator. 

[0036] As described in the preferred embodiment, the sharpening processor 20 operates upon only a luminance 
digital image channel. However, as an alternative embodiment, the sharpening processor could be applied to each of 
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the red, green, and blue digital image channels. In this case, the digital color image signals (which are RGB signals) 
would be directly applied to the sharpening processor 20. 

[0037] In Fig. 3, which illustrates a block diagram of the sharpening processor 20, the digital image channel n(x,y) 
is shown to be divided into two portions by a pedestal splitter 50, that is, into a pedestal signal and a texture signal. 

5 The preferred embodiment of the pedestal splitter 50, shown in Fig. 5, outputs a texture signal n^x.y) and a pedestal 
signal n^x.y). The texture signal n^x.y) primarily contains the detail of the image, as well as the image noise. The 
pedestal signal n^tx.y) is a conceptually smooth signal, except at regions of the image containing large occlusion 
boundaries, where the pedestal signal contains the transition edge. An alternative embodiment of the pedestal splitter 
50, shown in Figure 5A, essentially comprises a linear FIR filter. In this alternative embodiment, the pedestal signal 

10 n ped (x,y) is essentially equivalent to a lowpass signal and the texture signal n txt (x,y) is essentially equivalent to a 
highpass signal. Since other spatial frequency divisions are possible, those skilled in the art will understand that the 
present invention will yield beneficial results for any number of definitions of texture signals and pedestal signals. 
[0038] Referring again to Fig. 3, the digital image channel n(x,y), the texture signal n M (x,y) and the noise table 6 are 
input to a texture modifier 70. The purpose of the texture modifier 70 is to enhance the magnitude of detail in the scene 

is in a noise sensitive manner. An estimate of the local signal/noise ratio (SNR) is made using information about the 
expected standard deviation of noise for a given intensity level as supplied by the noise table. This estimate of the 
local SNR is used to set the boost factor relating to the level of enhancement given to a local level of the texture signal. 
• This procedure will be described in detail hereinbelow. The output of the texture modifier 70 is an enhanced texture 
signal n'^x.y). Furthermore, the pedestal signal n^^y) is input to a pedestal modifier 60 for the purpose of increasing 

20 , edge contrast to make the edges appear to have greater clarity and sharpness. The purpose of the pedestal modifier 
60 is to enhance the image edges without producing artifacts. The method employed by the pedestal modifier 60 will 
be described in detail hereinbelow. The output of the pedestal modifier is an enhanced pedestal signal n'^^x.y). 
[0039] The outputs of the pedestal modifier 60 and the texture modifier 70 are input to an adder 80, which adds the 
enhanced texture signal n'^x.y) and the enhanced pedestal signal n' ped (x,y) together in order to produce the digital 

25 image channel output from the sharpening processor 20. The enhanced digital image channel n'(x,y) may be expressed 
as 

n'(x,y) = n' txt (x,y) + n'^fry) 

30 

[0040] Fig. 4 shows an alternative embodiment of the sharpening processor 20, illustrating that minor perturbations 
to the arrangement of the components often have only a slight effect on the output of the sharpening processor 20. In 
this regard, the pedestal splitter 50 outputs the texture signal n^x.y) and an avoidance signal a(x,y). The avoidance 
signal a(x,y) is an intermediate signal calculated by the pedestal splitter 50 for determining the location of edges in the 

35 image. The derivation of this signal will be described below. The value of the avoidance signal ranges from 0.0 to 1 .0. 
Image locations (x,y) having a value of the avoidance signal a(x,y) = 0.0 correspond with edge regions of the image; 
conversely, image locations (x,y) having a value of the avoidance signal a(x,y) > 0.0 correspond with regions of image 
detail or noise. As mentioned before, it is an object of this invention to allowfor independent control of the enhancement 
applied to detail, large edges, and noisy regions. Thus, in the digital image channel output from the sharpening proc- 

40 essor 20, it is desired that the edges (where a(x,y) = 0) be enhanced by the pedestal modifier 60, and that the regions 
of image detail or noise (corresponding to those locations where a(x,y) > 0.0) be enhanced by the texture modifier 70. 
[0041] To this end, the digital image channel n(x,y) is input to the pedestal modifier 60 and as before the texture 
signal n^x.y) is input to the texture modifier 70. The two resulting outputs from the pedestal modifier 60 and the texture 
modifier 70, the enhanced texture signal n'^x.y) and the enhanced pedestal signal n' ped (x,y), are input to an avoidance 

45 - adder 81 . The avoidance adder 81 requires three inputs: the two signals n'^x.y) and n' ped (x,y) to be summed, and 
the artifact avoidance signal (a(x,y)). The two signals to be summed undergo a transformation such that one of the 
signals to be summed is multiplied by a(x,y), and the other is multiplied by (1-a(x,y)). The two transformed signals are 
then added. The signal input which is scaled by a(x,y) is known as the M a(x,y) input" of the avoidance adder 81 and 
the signal input which is scaled by (1 -a(x,y)) is known as the "(1 -a(x,y))' 1 input of the avoidance adder 81 . In the case 

so of the present embodiment of the sharpening processor 20, the signal output from the avoidance adder can be ex- 
' pressed as: 

n'(x.y) = a(x,y)n txt (x,y) + (1 -a(x,y))n ped (x,y) 

55 

[0042] Referring to Fig. 5, the digital image channel n(x,y) input into the pedestal splitter 50 is split into a high pass 
signal n hp (x,y) and a low pass signal n 1p (x,y) by a frequency splitter 94. Although there are many known techniques 
for generating highpass and lowpass signals, the frequency splitter is preferably implemented with a Gaussian filter 
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having a standard deviation (sigma) of 0.9 pixels. The preferred value of the standard deviation of the Gaussian filter 
may vary with image size. The value of 0.9 pixels for the standard deviation was derived by optimizing the present 
invention with 1 024 by 1 536 pixel size images. This Gaussian filter is a two dimensional circularly symmetric low-pass 
filter whose filter coefficients may be derived by the following formula which is well known in the art: 

5 

g(i,j) = 1/(sigma sqrt(2rc)) exp[-(i 2 +j 2 )/(2 sigma 2 )] 

[0043] Where g(i j) = the Gaussian filter coefficient at the (i, j) * pixel 

10 sigma = the standard deviation of the Gaussian filter (0.9) 

n = the constant approximately 3.1415... 
In the preferred embodiment, i and j range from -3 to +3, inclusive, for a total of 49 coefficients for the filter g(i,j). Note 
that another technique, well known in the art, exists for separating a Gaussian filter into horizontal and vertical com- 
ponents for subsequent application for the purpose of computational cost reduction. In either case, the frequency 

is splitter 94 applies the Gaussian filter g(i,j) to the digital image channel n(x,y) by the process of convolution, which is 
well known in the art. The convolution may be expressed as: . 

n 1p (x,y) = 2£ n(x-i,y-j)g(i,j) 

20 

with the summations occurring over all i and j. The signal n 1p (x,y) resulting from this convolution process is the low- 
pass signal. The low-pass signal is output from the frequency splitter 94. In addition, the high-pass signal n hp (x,y) is 
output from the frequency splitter 94 after having been derived by the following relationship: 

25 n hp (x,y) = n(x,y) - n 1p (x,y) 

[0044] The low-pass signal n 1p (x,y) is input into an avoidance signal generator 1 04 for forming the avoidance signal 
a(x,y), as will be described in detail below. A texture signal generator 90 receives both the high-pass signal n hp (x,y) 
30 and the avoidance signal a(x,y) and both signals are multiplied therein for producing the texture signal n^x.y). Thus, 
the texture signal n^ (x,y) may be expressed as: 

n M (x,y) = a(x,y) * n hp (x,y). 

35 

The texture signal n^^y) computed by the texture signal generator 90 is then output by the pedestal splitter 50. In 
addition, as shown in broken line in Fig. 5, the avoidance signal a(x,y) may optionally be output by the pedestal splitter 
50, in particulars provide an inputto the avoidance adder 81 in the alternative embodiment of the sharpening processor 
20 shown in Fig. 4. 

40 [0045] A pedestal generator 100 receives the luminance digital image channel n(x,y) and the texture signal n w (x, 
y) and subtracts the texture signal from the luminance signal, which produces the pedestal signal n^^y). Thus, the 
pedestal signal may be expressed as: 

45 rip^ (x,y) = n(x,y) - n txt (x,y). 

The pedestal signal n ped (x,y) computed by the pedestal signal generator 1 00 is then output from the pedestal splitter 50. 
[0046] An alternative embodiment of the pedestal splitter 50 (identified as 50A) is shown in Fig. 5A. The luminance 
digital image channel n(x,y) input into the alternative embodiment of the pedestal splitter 50A is split into a high pass 

so signal and a low pass signal by a frequency splitter 94 preferably with the Gaussian filter as described above having 
a standard deviation (sigma) of 0.9 pixels. The preferred value of the standard deviation of the Gaussian filter may 
vary with image size. The value of 0.9 pixels for the standard deviation was derived by optimizing the present invention 
with 1024 by 1536 pixel size images. The frequency splitter 94 applies the Gaussian filter g(i,j) to the digital image 
channel n(x,y) by the aforementioned process of convolution. 

55 [0047] The signal n 1p (x,y) resulting from this convolution process is the low-pass signal output from the frequency 
splitter 94. In addition, a high-pass signal n^x.y) is output from the frequency splitter 94 after having been derived by 
the following relationship: 
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%(x,y) = n(x,y) - n lp (x,y) 

[0048J In this alternative embodiment of the pedestal splitter, the lowpass signal n^(x,y) is output from the pedestal 
5 splitter as the pedestal signal n^x.y). (i.e., in this case, the pedestal signal n^x.y) is set equal to the lowpass signal 
n 1p (x,y) rather than being derived with a control signal). Likewise, the texture signal n^x.y) is set equal to the highpass 
signal n^,(x,y). 

[0049] This alternative embodiment of the pedestal splitter 50A simply performs a digital filtering operation by con- 
volution and outputs the highpass and lowpass signals as the texture and pedestal signals, respectively. This embod- 
10 iment of the pedestal splitter 50A is simpler than the preferred embodiment 50 because no control signal is used or 
calculated. However, the quality of the digital image output from the preference sharpener 4 employing this alternative 
embodiment is inferiorto the quality of the digital image outputfrom the preference sharpener 4 employing the preferred 
embodiment of the pedestal splitter 50. 

[0050] Those skilled in the art will recognize that there are many types of operations that may be used to generate 
is two signals that essentially sum to generate the digital image channel. The preferred embodiment of the pedestal 
splitter and the alternative embodiment of the pedestal splitter are both examples of operations that may be used to 
separate a digital image channel into two signals that essentially sum to generate the digital image channel. 
[0051 ] Referring to Fig. 6, there is illustrated a block diagram of the avoidance signal generator 1 04. In this regard, 
the low pass signal n 1p (x,y) is input into a non-directional squared gradient calculator 1 06 for producing a non-directional 
20 gradient signal. This calculation is performed by first calculating the difference between the pixel and its upper vertical 
neighbor, as well as the difference between the pixel and its horizontal neighborto the right. The non-directional squared 
gradient is the sum of the squares of these two differences. The non-directional squared gradient signal, ndg(x,y) may 
be expressed by the following equation: 

25 ndg(x,y) = [n 1p (x,y)-n 1p (x-1,y) f + [n 1p (x,y)-n 1p (x,y+1) f 

The value of ndg(x,y) is then mapped by an artifact avoidance function applicator 1 08 to produce an artifact avoidance 
signal a(x,y) as the output of the avoidance signal generator 104. 
30 [0052] Referring to Fig. 6, this mapping is performed by passing the non-directional squared gradient signal, ndg(x, 
y), through an artifact avoidance function av(y) formed in the following manner. The preferred embodiment of the 
present invention utilizes an artifact avoidance function defined by: 

av(y) = (1/2) (1 + COS(7t(y - C 0 ) /(C 1 - C 0 )) 

35 

fory >C 0 andy<C 1 , 



40 



fory >= C 1 and 



av(y) = 0 



av(y) = 1 

45 

for y <= C 0 where C 0 and C 1 are numerical constants. 

[0053] The preferred values for C 0 and C 1 will vary according to the range of the input data. The input data range in 
the images used in the development of this preferred embodiment ranged from 0 to 4095. In this case, the preferred 
so >. value for C 0 is 996, and the preferred value for C n is 8400. As an alternate method for constructing the artifact avoidance 
function is described in the following equation: 

av(y) = 1 - sqrt( (y - C 0 ) / {C, - C 0 )) 

55 

fory >= C Q andy<= C 1f 
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av(y) = 1 

for y < C 0 , and 

av(y) = 0 

fory > C v Fig. 7 shows an example plot of the function av(y). 

[0054] Note that in the preferred embodiment, the value of Cj is related to the size sigma (in standard deviations) 
of the Gaussian filter. The value of C 1 is inversely proportional to the square of sigma (in standard deviations) of the 
Gaussian filter. Preferably, may be determined by the relation: 

C 1 = 6804/(sigma*sigma) 

Also, C 0 is related to C 1 by the equation: 

(^ = 0.127^-18 

[0055] The artifact avoidance signal, a(x,y), is generated by the artifact avoidance function applicator 108. This is 
accomplished by applying the artifact avoidance function av(y), to the non-directional gradient signal ndg(x.y), as shown 
in Figure 7. The mathematical result is described by the equation: 

a(x,y) = av (ndg(x,y) ). 

The artifact avoidance function shown in Figure 7 is most efficiently implemented as a look-up-table (LUT). 
[0056] It is helpful to understand that the avoidance signal a(x,y) is an example of a control signal created from a 
spatially filtered version of the digital image channel. To begin with, a generalized linear spatial filter is described by 
the equation 

c(x,y) = IZd(x-i,y-j)g(i,j) 

where the d(x-i,y-j) values represent local pixel values surrounding the (x,y)* pixel and the g(i.j) values represent 
numerical coefficients of a digital filter that do not depend on the pixel values. A non-linear spatial filter herein described 
shall be defined as a spatial filter which cannot be described by the linear spatial filter equation. The output of applying 
a generalized control signal to an input signal bears a multiplicative relationship to the input signal. An example of 
applying a control signal is given by the equation: 

c(x,y) = h(x,y)d(x,y) 

where the d(x,y) values represent the input signal (x.y)* pixel values and the h(x,y) values represent the (x,y) th pixel 
values of the control signal. The result of applying a control signal to an input signal falls into the general category of 
a non-linear spatial filter if the control signal is derived from a spatial filtered version of the input signal. The avoidance 
signal a(x,y) is an example of a control signal created from a spatially filtered version of the digital Image channel. The 
texture signal n txt (x,y) described in the preferred embodiment is an example of a non-linear spatial filter produced with 
the application of a control signal and a digital filter applied to the image channel n(x,y). 

[0057] Referring now to Fig. 8, the pedestal modifier 60 shown therein is a sharpening filter algorithm that is adaptive 
to the morphology of a digital image channel, as based on one or more image characteristics calculated over a localized 
region of the digital image channel (as isolated by a two-dimensional window). The filtering algorithm includes a stage 
for normalizing the tone scale conversion with a scaling function for the image statistic(s) over the localized region of 
a digital image channel and then using the scaled tone scale to reshape the structure of edges in the digital image 
channel. More specifically, the shape of the local tone scale function is ordinarily selected before processing the image, 
but the exact scaling and translation of the local tone scale operation is determined from the statistics in any localized 
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region. Accordingly, after the region is isolated, implementation of the algorithm includes identifying a desired statistical 
characteristic from the local region, performing a local tone scale conversion that is normalized in relation to the sta- 
tistical characteristic, and mapping the central pixel of the local region through the tone scale conversion to generate 
an enhanced central pixel value. More detail of the pedestal modifier 60 Is described in commonly assigned U.S. Patent 

5 Application Serial No. 09/324,239, entitled 8 A Method for Enhancing the Edge Contrast of a Digital Image 0 and filed 
June 2, 1999 in the names of A.G. Gallagher and E.B. Gindele, and which is incorporated herein by reference. 
[0058] The pedestal modifier 60 may be implemented in several modes. More specifically, and particularly as shown 
in the block diagram of Figure 8, the pedestal modifier 60 is preferably practiced in a first mode by scaling the input 
pixel values to the local maximum and minimum for each region and then applying the scaled input values to a tone 

10 scale function with normalized coordinates; the output obtained by this conversion operation is then processed with 
an inverse of the scaling function (used to generate the input) to obtain the enhanced output value. Alternatively, in a 
second mode of implementing the pedestal modifier 60, a local tone scale is constructed having coordinates that are 
bounded by the local maximum and minimum for each region, and then each central pixel value is mapped through 
the bounded coordinates of the tone scale function. This will directly produce the enhanced output value. In a third 

is mode, only the input of the tone scale function is scaled with the inverse scaling function and the output pixel is proc- 
essed with the inverse of the scaling function; in a fourth mode, only the output of the tone scale function is scaled and 
the input pixel is processed with the scaling function. In any mode, the shape of the tone scale function may remain 
fixed over the image; however, it may be desirable to vary the shape of the tone scale function dependent upon the 
statistical characteristics of the region. Furthermore, while it may be typical to apply the normalized tone scale operation 

20 to substantially all the pixels in the input digital image channel, it may be desirable to only apply the method to selected 
areas of the digital image channel. For details of the second, third and fourth modes, the reader is directed to the 
aforementioned Serial No. 09/324,239, which is incorporated herein by reference. These alternative modes provide a 
processed digital image channel identical to the processed digital image channel obtained by the pedestal modifier 60 
disclosed in the preferred embodiment (i.e., the first mode, Fig. 8). 

25 [0059] Referring further to Fig. 8, there is illustrated a block diagram of a preferred embodiment for implementing 
the pedestal modifier 60 according to the first mode as set forth above. It also facilitates understanding to note that the 
preferred embodiment of the pedestal modifier 60 is described in reference to a relatively high resolution digital image 
channel having, e.g., dimensions of 1024 pixels in height by 1536 pixels in width, although the invention is similarly 
operative with image channels having greater or lesser image resolutions. The choice of image resolution, however, 

30 may have a concomitant effect on the window size, i.e., while a 5 X 5 window has been found preferable for 1 024 X 
1536 resolution, the choice of a higher resolution image sensor would ordinarily allow a larger window size, and vice 
versa for a lower resolution sensor. 

[0060] With reference also to Fig. 9, the value of each input central pixel 1 1 0 of the digital representation of the digital 
image channel is first passed to a local statistics determiner 1 1 6 for calculating local statistics. The values of surrounding 

35 pixels 114 included within a local region 112 are also passed to the local statistics determiner 116. The local region 
112 and the input pixel 110 constitute a spatial region of the digital image channel. In the preferred embodiment, the 
local region about each input pixel 11 0 is defined as a square neighborhood centered on the input pixel for which the 
local statistics are being determined. In the preferred embodiment, the local region is a square . neighborhood with 5 
pixels on each side. Figure 9 illustrates the local region implemented in the preferred embodiment. The pixels 114 

40 included within the local region 112 are illustrated as the 24 pixels (indicated by hatching) surrounding the input pixel 
110 passed to the local statistics determiner 1 1 6. Those skilled in the art will recognize that the present invention will 
be operable with a large variety of local region sizes and shapes, and the usage (in this description and as claimed) 
of the term "central" to describe the processed pixel merely refers to a pixel having a local surround of pixels, rather 
than a pixel at the centroid of its local region. 

45 [0061] In Figure 8, the value u of each central pixel 110 is input to the local statistics determiner 116 and a scaling 
function evaluator 120. In addition, the values of the pixels 114 in the local region are input to the local statistics 
determiner 1 1 6 in order to generate a statistical characteristic of the local region . A scaling function generator 1 1 8 uses 
the statistical characteristic to generate a scaling function s(x) that is applied to the scaling function evaluator 120 in 
order to normalize the value u of each input pixel 1 1 0 and thereby generate a first intermediate value I . The statistical 

so characteristic is also used by an inverse scaling function generator 1 22 to generate a function s" 1 (x) that is the inverse 
of the scaling function s(x). The first intermediate value I is then applied to a tone scale applicator 124, which maps 
the intermediate value I through a tone scale function f(x) provided by a tone scale function generator 126 in order to 
generate second intermediate value l 2 . The output intermediate value l 2 from the tone scale applicator 124 is then 
applied to an inverse scaling function applicator 128, which generates a processed value u' in the system image space 

55 by using the inverse function s* 1 (x) provided by the inverse scaling function generator 122. 

[0062] More specifically, the local statistics determiner 1 1 6 calculates several characteristics that describe the image 
data contained in the local region 1 1 2 and the input pixel 1 1 0. The local statistics could be any mathematical combination 
of the pixel values contained in the local region 112 and the input pixel 110. In the preferred embodiment, the local 
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statistics determiner 1 1 6 determines two local statistics, the maximum and minimum pixel values from the local region 
112 and the input pixel 110. As an alternative, the local statistics determiner 116 could determine the mean of the n 
maximum pixel values, and the mean of the m minimum pixel values, where n and m are integers much smaller than 
the number of pixels contained in the local region 1 1 2, for example, n = m = 3. As will be described, these local statistics 
are utilized in the generation of the scaling function s(x) and the Inverse scaling function sr 1 (x). 
[0063] The local statistics determined by the local statistics determiner 1 1 6 are then passed to the scaling function 
generator 118 and the inverse scaling function generator 122. In the preferred embodiment, the scaling function may 
be represented with the following equation: 



where X represents the maximum pixel value from the local region 1 1 2 and N represents the minimum pixel value from 
the local region 112. The purpose of the scaling function is to modify the value of the central pixel 110 such that the 
modified pixel value may be used as an input to a tone scale function 130, as shown in Figure 10. In the preferred 
embodiment, this tone scale function 130 is applied as a look-up-table (LUT). In the preferred embodiment, the effect 
of the. scaling function is to normalize (i.e., compress) the interval [N X] of input values to an interval [0 1], as shown 
in Fig. 10. 

[0064] In a similar manner, the inverse scaling function generator 1 22 creates the inverse scaling function s" 1 (u); the 
inverse scaling function s" 1 (u) may be represented by the following equation: 



The purpose of the inverse scaling function is to scale the output values obtained from the tone scale function 130 
back to the interval [N X]. The scaling function and the inverse scaling function are indeed Inverses, as it can easily 
be shown that s _1 (s(u)) = u. 

[0065] The value of the input pixel 1 1 0 is then passed to the scaling function evaluator 1 20 in order to generate an 
intermediate value I = s(u), where I is the intermediate value, s(x) is the scaling function, and u is the value of the input 
pixel 110. The output of the scaling function evaluator 120 is the intermediate value I. The intermediate value I is then 
passed to the tone scale applicator 124. The purpose of the tone scale applicator 124 is to affect the contrast of the 
value of the input pixel 1 1 0 with respect to the local region 1 1 2. The tone scale applicator 1 24 modifies the intermediate 
value I, thereby creating the second intermediate value l 2 . The tone scale applicator 124 modifies the intermediate 
value I with the tone scale function 130 (i.e., f(x)). Thus, the operation of the tone scale applicator may be expressed 
in the following equation: l 2 = f(l), where l 2 is the second intermediate value, f(x) is the tone scale function, and I is the 
intermediate value output from the scaling function evaluator 120. 

[0066] The tone scale function f(x) is generated by the tone scale function generator 126. In the preferred embodi- 
ment, the tone scale function f(x) is the sigmoid function, formed by integrating a Gaussian probability distribution 
function, and is well known in the art. The sigmoid function is fully characterized by the standard deviation o of the^ 
Gaussian probability function that is integrated. The tone scalef unction f(x) may be expressed by the following formula: 



In the preferred embodiment, the tone scale function is found by computing the summation of discrete samples of a 
Gaussian distribution, as shown in the following formula: 




s" 1 (u) =u(X-N)+N 
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10 u-a * 

Z ex p 2 " J 

u=-a 

15 

where 2a is the number of samples in the LUT. In the preferred embodiment, a = 50. 

[0067] Notice that the slope of the tone scale function f (x) evaluated at x = 0.5 may be determined by the relationship: 

1 

Y = 



where y is the slope of the sigmoid function evaluated at x = 0.5, and the approximate slope of the summation described 
25 above, and o is the standard deviation of the Gaussian probability function. When the value of y> 1 .0, the operation of 
the present invention sharpens the digital image channel by reshaping the local structure of edges. When the value of 
y is < 1 .0, the operation of the present invention tends to produce an image with a softer appearance than the input 
image. In the preferred embodiment 7= 2.1 and a = 0.1 9. In the preferred embodiment, the tone scale function f(x) is 
independent of the local statistics output from the local statistics determiner 116, and thus need be computed only one 
30 time per image channel, despite the number of pixels being processed. 

[0068] Figure 1 0 illustrates a variety of tone scale functions, one of which is shown as the tone scale function 130, 
and the associated standard deviations of the Gaussian probability function a. Those skilled in the art will recognize 
that a wide variety of functions in addition to the sigmoid function will accomplish the goal of the tone scale applicator 
124. 

35 [0069] The second intermediate value l 2 output from the tone scale applicator 124 is passed to the inverse scaling 
function applicator 1 28. In addition, the inverse scaling function s" 1 (x) output from the inverse scaling function generator 
122 is passed to the inverse scaling function applicator 128. The purpose of the inverse scaling function applicator 
128 is to generate the processed pixel value u' from the second intermediate value l 2 . The inverse scaling function 
applicator 128 generates the enhanced pixel value u' by evaluating the inverse scaling function: 



u' = s- 1 (l 2 ) 



Substituting for l 2 and I, 

45 

u'=s" 1 (f{s(u)}) 

where s' 1 (x) represents the inverse scaling function, f{x} represents the tone scale function, s(x) represents the scaling 
so function, u represents the value of the input pixel 110, and u' represents the value of the enhanced pixel. The digital 
image channel output from the pedestal modified 60 is an enhanced pedestal signal n'p^x.y). 
[0070] Typically, the process for generating a processed pixel value u' from the pedestal modifier 60 is repeated for 
every pixel of the digital image channel in order to generate a processed pixel value corresponding to each pixel in the 
digital image channel. These processed pixel values, when considered as a collection, form a processed digital image 
55 channel. Alternatively, the process for generating a processed pixel value u' may repeated for a subset of every pixel 
of the digital image channel in order to generate a processed pixel value corresponding to a subset of pixels in the 
digital image channel. In the latter case, the subset, when considered as a collection, forms a processed image for a 
portion of the channel. In general, the parameters of the present algorithm may be adjusted in order to produce an 
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enhanced digital image channel, with the appearance of greater edge contrast and more clarity than the digital image 
channel. 

[0071] The pedestal modifier 60 requires definition of two parameters: the size of the local region (which may be 
described by a window size for the sharpening filter) and the shape of the tone scale conversion function (which may 

5 be described by the slope of the tone scale function). The algorithm tends to perform best when the window size is 
kept fairly small, e.g., no greater than say about 7X7 pixels for a 1024 X 1536 imager. Indeed, as the window size 
and slope of the local tone scale function increase, the image begins to have a "paint-by-n umber" artifact. Also, a large 
window tends to compress texture on either side of a large occlusion boundary type edge in an image because the 
maximum and the minimum tend to occur on opposite sides of the edge. This effect is reduced by keeping the window 

10 size relatively small. A window size of 5 X 5 or fewer pixels has been found generally preferable for producing satis- 
factory results in typical situations for a 1 024 X 1536 resolution. As mentioned earlier, other suitable window sizes may 
be empirically determined without difficulty for other image resolutions; alternatively, a larger window may be acceptable 
in certain situations for a given resolution if the user is willing to accept increased artifacts in order to obtain the sharp- 
ening effect of the larger window. 

15 [0072] The pedestal modifier as herein described has the advantage of controlling the value of the central pixel in 
accordance with a statistical characteristic of the region, e.g., driving the value of the central pixel either toward the 
local maximum or the local minimum of the region, except in the case where the central pixel is substantially midway 
between the local maximum and the local minimum. Consequently, edge transitions occur over a narrower range of 
pixels than in the input image, thus generating an image that appears to be sharper, or more in focus, than the original 

20 image. Moreover, since the output of the tone scale conversion is modified by the statistical characteristic, e.g., bounded 
by the local maximum and the local minimum of the region, systematic overshoot and undershoot at an edge boundary 
is diminished and the ringing artifact is not as noticeable. 

[0073] A detailed view of the texture modifier 70 can be seen in Fig. 11 . The texture modifier 70 inputs the digital 
image channel n(x,y), the texture signal n^x.y) and the luminance noise table 6. The output of the texture modifier 

25 70 is an enhanced texture signal n'^x.y). The purpose of the texture modifier 70 is to boost the texture signal by a 
factor that is related to an estimate of the local signal to noise (SNR) ratio. Thus, the portion of the texture signal 
coincident with regions of the digital image channel having high SNR will experience a greater level of boost as com- 
pared with the portion of the texture signal associated with low SNR regions of the digital image channel. For example, 
suppose that an image to be sharpened contains a large region of clear blue sky. The only modulation in this region 

30 is likely to be noise resulting from the imaging system. Therefore, it is not desirable to increase to amplitude of this 
modulation. On the other hand, modulation of a grassy field is a result of the modulation due to many blades of grass 
in addition to image system noise. In this case, it is preferable to boost the modulation since it can be attributed to 
actual modulation in the scene. In the present invention, the signal to noise ratio is estimated to act as a classifier that 
may be used to distinguish between, e.g., the two aforementioned types of regions in a scene. 

35 [0074] In this regard, the digital image channel n(x,y), the texture signal n^x.y) and the luminance noise table 6 are 
input to a local SNR estimator 1 60. The purpose of the local SNR estimator 1 60 is to estimate the local signal to noise 
ratio which will later be used to determine the level of boost given to a specific pixel of the texture signal. In the preferred 
embodiment, the output of the local SNR estimator 1 60 is one estimate of the SNR for each pixel in the digital image 
channel, represented by the symbol SNR(x,y). However, it is also possible that the SNR may be calculated for only a 

40 subset of the pixels' locations of the digital image channel. The local SNR estimator 160 will be described in greater 
detail hereinbeiow. 

[0075] The output of the local SNR estimator 1 60, SNR(x,y), is passed into a gain determiner 134. The gain deter- 
miner 134 is meant to determine an individual level of boost B(x,y) to apply at each particular (x,y) location of the 
texture signal, given that an estimate of the local SNR is known. This is accomplished by the use of a look up table 
45 (LUT), for example the LUT shown as a plot in Fig. 15. In the preferred embodiment, this LUT is monotonically increas- 
ing. The LUT output (the gain) increases with the increase of the LUT input (the estimate of the SNR.) 
[0076] The equation for the LUT shown in Fig 15 is given as: 

so B ( x .y) = sfmm for SNR(x,y) <SNR min 

B(x,y) = sf m! n+(sf m ax-sf mjn )(SNR(x,y)-SNR nijn V(SNR max -SNR niln ) 
55 forSNR mln <SNR(x,y)<SNR max 

B ( x > v ) = sf max f or SNR(x.y) > SNR max 
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Where sf mflx is > sf mIn , and SNR^ > SNR min . In the preferred embodiment, sf max is 3.5, sf min is 2.0, SNR,,,^ is 2.0 
and SNR mln is 0.4. 

[0077] The gain B(x,y) output by the gain determiner 134 and the texture signal n^x.y) are then both passed to a 
texture booster 136. The purpose of the texture booster 136 is to multiply each value of the texture signal n^x.y) by 
5 its associated gain. The output of the texture booster 1 36 is the enhanced texture signal n'^x.y), given by the equation: 

n' M (x,y)»n M (x.y) i B()yf) < 

10 This enhanced texture signal n'^x.y) output from the texture modifier 70 is then passed to the adder 80 in Fig. 3 (or 
to the avoidance adder 81 In the case of the alternative embodiment shown in Fig. 4.) Note that when B(x,y) < 1 .0, the 
magnitude of the enhanced signal is less than the magnitude of the original texture signal ln bd (x l y)l>ln a M (x l y)l. Thus, 
if the present invention is tuned such that in noisy regions, B(x,y) <1 .0, the processed digital image channel will appear 
to have less noise than the digital image channel input to the preference sharpener 2. 

is [0078] A detailed block diagram of the local SNR estimator 160 may be seen in Fig 12. The digital image channel n 
(x.y) is first input to a local variance computer 1 70. The purpose of the local variance computer 1 70 is to attain a local 
estimate of signal activity. In the preferred embodiment, the local variance computer 170 calculates the local variance 
a R 2 (x,y) over a window of size W by W pixels. I n the preferred embodiment W = 7 pixels, although it has been determined 
that alternately sized windows perform the task with nearly equivalent results. 

20 [0079] The computation of the local variance of a set of values is well known in the art, and may be expressed as: 

o R 2 (x,y) = ^{x+i.y+jf W 2 - ( Vx+/,y+yVW 2 ) 2 

25 Where / and / both range from -3 to +3, inclusive, for a total of W 2 = 49 pixels included in the computation of the variance 
a R 2 (x,y). Calculation of the variance at edges involves mirroring, a technique well known in the art of image processing. 
The output of the local variance computer 170 is a local variance for each pixel in the digital image channel. 
[0080] A subtracter 1 72 inputs both the digital image channel n(x,y) and the texture signal n^x.y). The output of the 
subtracter 172 is the pedestal signal n^^y). The subtracter 172 determines the pedestal signal by subtracting the 

30 texture signal n^xy) from the digital image channel n(x,y), according to the formula: 

n ped (x f y) = n(x t y) - n M (x t y) ^ 

35 Note that this pedestai signal n^Jx.y) is identical to the pedestal signal determined by the pedestal splitter 50. In a 
practical implementation of the present invention, the pedestal signal need only be computed once. 
[0081] The noise table 6 and the pedestal signal n ped (x,y) are input an expected noise determiner 1 90. The noise <• 
table contains the relationship between expected noise o N tf) and intensity / of the digital image channel n(x,y). In the 
preferred embodiment, the noise table is a two column table, a sample of which is shown hereinbelow in a two column 

40 list. The first column represents intensity level and the second column represents the expected standard deviation of 
noise for that intensity level. 
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[0082] The noise table may also be specified in terms of a four column table, where the first column is the intensity 
i, and the second to fourth columns correspond to the standard deviations of noise expected in the red, green, and 
blue channels, respectively, of the digital image channel input to the preference sharpener 2. In this case, the expected 
30 standard deviation of noise for intensity level i of the luminance channel n(x,y) is dependent upon the coefficients of 
the color rotation matrix used to generate the luminance channel, as given by: 

c n (i) = sqrt((o r (i)*rcoef) 2 + (o g (irgcoef) 2 + (o b (irbcoef) 2 )) 

35 

where o n (i) is the expected standard deviation of noise at intensity i for the luminance digital image channel n(x,y). 
Likewise, a r (i), a g (i), a b (i) are the expected standard deviations of noise of the respective red, green, and blue digital 
image channels at intensity i, and rcoef, gcoef, and bcoef are the coefficients of the color rotation matrix used to 
generate the luminance digital image channel n(x,y). As previously mentioned, in the preferred embodiment all three 
40 of these coefficients equal 1/3. Consequently, the luminance channel given in the preferred embodiment is given by: 

a n (i)=1/3*sqrt(o r (i) 2 + a g (i) 2 + a b (i) 2 ) 

45 Thus a noise table corresponding to the luminance digital image channel n(x,y) may be either supplied or calculated 
by the expected noise determiner 190. 

[0083] The expected noise determiner 1 90 outputs an intensity dependent estimate of the standard deviation of noise 
<*u( x >y) for tne intensity level of the pedestal signal n^xy). The expected noise determiner 190 either performs a 
table look-up, which relates the intensity of the pedestal signal to the expected standard deviation of noise o u (x,y), or 
so calculates the expected noise, as described above. The output o N (x,y) of the expected noise determiner 1 90 may be 
represented as: 

ou( x 'y)=°u( n p*i( x >y))- 

55 

If the value of n ped (x,y) is not coincident with a value of / for which c n (/) exists, then linear interpolation is used to 
determine a value for o n (n ped (x,y)). Linear interpolation is well known in the art and will not be further discussed. A plot 
of a noise table can be seen in Fig. 14. 
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[0084] The procedure for generating a noise table such as the one illustrated in Fig. 1 4 can be found in U.S. Patent 
No. 5,641 ,596 issued June 24, 1997 to Gray et al. or in U.S. Patent No. 5,923,775 issued July 13, 1 999 to Snyder et 
al., both of which are incorporated herein by reference. 

[0085] An SN R calculator 1 80 inputs both the expected standard deviation of noise o N (x t y) output from the expected 
5 noise deteiminer 1 90, and the local variance c R 2 (x,y) output from the local variance computer 1 70. The SNR calculator 
180 estimates a local signal to noise ratio SNR(x,y) by computing the ratio of the signal variance (assuming that the 
local variance c R 2 (x,y) is the sum {in an RMS sense} of the variance due to signal and the variance due to noise.) 
Thus, the output of the SNR calculator 180 is an estimate of the local SNR at each pixel location, according to the 
following formula: 

10 

SNR(x.y) = sqrt(G R 2 (x f y) - o N 2 (x,y)) / a N (x,y). 

Note that before attempting the square root operation, the value of c R 2 (x,y)-a N 2 (x,y) is checked to ensure that it is 

15 positive. If it is not, the value of SNR (x,y) is set to equal 0.0. 

[0086] Notice that many other estimates of the signal to noise ratio may be formulated without deviating from the 
spirit of the present invention. For example, an alternative embodiment of the local SNR estimator 1 60 is shown in Fig. 
1 3. The purpose of this embodiment is to provide an estimate of the local SNR by a means that is computationally less 
expensive that by that shown in Fig. 1 2. In this alternative embodiment, the noise and signal deviation are both assumed 

20 to be Gaussian distributed, which allows for the use of mean absolute deviation (MAD) rather than standard deviation. 
The calculation of mean absolute deviation does not involve the computationally expensive square root and squaring 
operations. In this embodiment, the texture signal n^y) and the digital image channel n(x,y) are again input to the 
subtracter 1 72 for the purpose of producing the pedestal signal n^xy), as previously described. The pedestal signal 
n ped (x t y) will again be used as an input to the expected noise determiner 1 90 to determine the value of (5 H (x,y). 

25 [0087] The texture signal n^x.y) is input to the local MAD calculator 200 in order to determine the local mean 
absolute deviation in the texture signal. By assuming that the mean value of the texture signal n^xy) is 0, the formula 
for computing the local MAD used by the local MAD calculator 200 is given as: 

30 MAD R (x,y) = El n M (x+i t y+j) l/W 2 

where i and j preferably both range from -3 to +3, for a total of W 2 = 49 pixels included in the calculation of the mean 
absolute deviation. The local MAD calculator 200 outputs the value of the mean absolute deviation MADR(x,y), which 
will later be used in calculations necessary for determining the estimate of the local SNR. 

35 [0088] The purpose of a noise table adjuster 21 0 is to compensate for the differences between calculating MADR 
(x,y) of the texture signal, and calculating the standard deviation o R (x,y) of the digital image channel. The noise table 
adjuster 210 modifies the luminance noise table for the purpose of using mean absolute deviation, rather than standard 
deviation. Assuming, as previously mentioned, that the luminance noise table contains the relationship between ex- 
pected noise c n (i) and intensity /, It is known in the art that the MAD of a Gaussian distribution is related to the standard 

40 deviation a of that distribution by the following relationship: 

MAD = sqrt (2/it) o 

45 Thus, in order to translate the luminance noise table from the metric of standard deviation to the metric of MAD, each 
value of o n (i) must be scaled by about 0.8. 

[0089] In addition, there is the difference between this alternative embodiment and the preferred embodiment con- 
cerning which signal is used for computation of the local signal activity measure. In the preferred embodiment, the 
variance of the digital image channel is computed. In this alternative embodiment, the texture signal is used to calculate 

so the value of MAD R (x,y), providing a computational benefit when the signal mean is assumed to be zero. Thus the 
relationship of the texture signal n M fx,yJ to the digital image channel n(x t y) must be understood in order to adjust the 
luminance noise table to account for this. This relationship can be easily expressed only if the digital filtering process 
used to generate the texture signal is linear. For the sake of this step, the effects of the artifact avoidance signal are 
ignored, and the texture signal is assumed to be equivalent to the highpass signal. For a general (n x m) filter with 

55 coefficients h(ij), wherein /= -(n-1)/2, -(n-3)/2 n-1/2 and/= -(/tM)/2, -(m-3)/2,...,m-1/2, the variance of the filtered 

signal is related to the variance of the original signal by the following relationship: 
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where a 2 fe represents the variance of the filtered signal, ct 2 0s represents the variance of the original signal, and the 
5 summation occurs over / and / 

[0090] Thus, in the case of the present invention, the filter h(i,j) is assumed to be expressed as: 

h(U) = &(iJ)-g(iJ) 

10 

where 8 ft/I is the delta function which has a value of one at i = 0 and / = 0 and a value of zero everywhere else. This 
expression accounts for the previously described process of generating the texture signal (ignoring the artifact avoid- 
ance signal) by blurring the digital image channel with a Gaussian filter g(ij), then subtracting the result from the digital 
image channel. Thus, considering this description, the noise table adjuster 210 must scale each value of the luminance 
15 noise table by a factor to account for the estimation of local signal activity on the texture signal rather than the digital 
image channel. This factor f can be expressed as: 

f=sqrt(ZZh(i,j) 2 ) 

20 

where the summation occurs over / and /, and h(ij) is as previously described. The square root of the result is taken 
because the luminance noise table is in the units of standard deviation, rather than variance. 
[0091] Thus, the operation of the noise table adjuster 210 is to scale each entry a n (/) of the luminance noise table 
by a factor m equal to 

25 

m = r sqrt (2/n) 

in order to compensate for the calculation of MAD rather than standard deviation, and the calculation with the texture 

30 signal rather then the digital image channel. 

[0092] The modified noise table output from the noise table adjuster 21 0 is passed as an input to the expected noise 
determiner 190 for the purpose of attaining an estimate of the expected MAD from noise, MAD N (x,y). The expected 
noise determiner 190 uses the modified noise table to determine the value of MAD N (x,y) for each value of n ped (x,y). 
The output of the expected noise determiner 1 90 is the value of MAD N (x,y) at each location of the digital image channel. 

35 [0093] The SNR calculator 1 80 ofthe alternative embodiment shown in Fig. 13 acts essentially the same as the SNR 
calculator 1 80 of the preferred embodiment. The purpose of the SNR calculator 1 80 is to output a value of estimated 
SNR at each location of the digital image channel. To this end, the SNR calculator 1 80 calculates the following formula: 

40 SNR(x.y) = sqrt(MAD R (x,y) 2 - MAD N (x,y) 2 ) / MAD N (x,y) 

The estimate ofthe local SNR is output from the local SNR estimator 160 and input to the gain determiner 134, shown 
in Fig. 1 1 in order to allow for the determination of the appropriate boost factor for the texture signal at each location. 
[0094] In summary, the use of the pedestal splitter 50, decomposing the image into a signal containing the image 

45 detail and another signal primarily containing the large image edges, allows for independent control ofthe enhancement 
applied to edges and texture. Edges are reshaped by a morphological operation in order to increase edge contrast 
and avoid boundary artifacts. Texture in enhanced with regard to an estimate ofthe local signal to noise ratio. 
[0095] The present invention has been described with reference to a preferred embodiment. Changes may be made 
to the preferred embodiment without deviating from the scope of the present invention. For instance, in the preferred 

so embodiment, a calculation of the local SNR is made for each pixel of the digital image channel. However, it is conceiv- 
able that the calculation of the SNR could be made for only every N* pixel in order to reduce computational cost, and 
replicated or interpolated. Calculation of the local SNR was described with reference to a local variance calculation on 
the digital image channel n(x,y). Additionally, an alternative embodiment described a method by which local SNR may 
be estimated based upon using a MAD calculation upon the texture signal n^x.y). Those skilled in the art will recognize 

55 that the local SNR may also be estimated by performing a variance calculation on the texture signal, or by performing 
a MAD calculation upon the digital image channel n(x,y). Such modifications to the preferred embodiment do not sig- 
nificantly deviate from the scope of the present invention. 
[0096] Other aspects of the invention include: 
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1. The method in which the region of the step of providing image values from the first signal corresponding to 
image pixels from a region of the image comprises a 5 X 5 or smaller array of image pixels. 

2. The method in which the step of performing the normalized tone scale conversion on a central pixel of the region 
5 in order to generate a first signal with enhanced image values further comprises processing the intermediate value 

of the central image pixel output from the tone scale function with a function that is the inverse of the scaling function. 

3. The method in which the step of providing a predetermined tone scale conversion to enhance the digital image 
channel includes the application of a predetermined tone scale function and the step of normalizing the predeter- 

10 mined tone scale conversion for the statistical characteristic in order to generate a normalized tone scale conversion 

comprises normalizing the coordinates of the tone scale function based on the statistical characteristic. 

4. The method in which the step of providing a predetermined tone scale conversion to enhance the digital image 
channel includes application of a predetermined tone scale function, and the method further comprises the step 

is of adjusting a parameter of the tone scale function based on the statistical characteristic of the region. 

5. The method in which the step of adjusting a parameter of the tone scale function comprises varying the slope 
of the tone scale function. 

20 6. The method in which the steps of providing image values from the first signal corresponding to image pixels 

from a region of the image, of identifying a statistical characteristic of the image pixels in the region, of normalizing 
the predetermined tone scale conversion for the statistical characteristic in order to generate a normalized tone 
scale conversion, and of performing the normalized tone scale conversion on a central pixel of the region in order 
to generate a first signal with enhanced image values are repeated for consecutive overlapping regions such that 

25 contiguous central pixels are processed through the tone scale conversion. 

7. The method wherein the steps of normalizing the predetermined tone scale conversion for the statistical char- 
acteristic in order to generate a normalized tone scale conversion and of performing the normalized tone scale 
conversion on a central pixel of the region in order to generate a first signal with enhanced image values include 

30 application of a predetermined tone scale function to all central image pixels processed through the normalized 

tone scale conversion. 

8. The method in which the step of providing a predetermined tone scale conversion to enhance the digital image 
channel includes the application of a predetermined tone scale function having input and output coordinates, the 

35 step of normalizing the predetermined tone scale conversion for the statistical characteristic in order to generate 

a normalized tone scale conversion comprises normalizing the input coordinate of the tone scale function with a 
scaling function based on the statistical characteristic and normalizing the value of the central pixel output from 
the tone scale function based on the inverse of the scaling function, and then the step of performing the normalized 
tone scale conversion on a central pixel of the region in order to generate a first signal with enhanced image values 

40 comprises mapping the value of the central pixel through the tone scale function to generate a scaled output pixel. 

9. The method in which the step of providing a predetermined tone scale conversion to enhance the digital image 
channel Includes the application of a predetermined tone scale function having input and output coordinates, the 
step of normalizing the predetermined tone scale conversion for the statistical characteristic in order to generate 

45 a normalized tone scale conversion comprises normalizing the value of the central pixel input to the tone scale 

function with a scaling function based on the statistical characteristic and normalizing the output coordinate of the 
tone scale function based on the inverse of the scaling function, and then the step of performing the normalized 
tone scale conversion on a central pixel of the region in order to generate a first signal with enhanced image values 
comprises mapping the scaled value of the central pixel through the tone scale function to generate a processed 

so output pixel. 

10. A method for enhancing a digital image processed through a digital image channel comprised of a plurality of 
image pixels, the method comprising the steps of: 

55 (a) splitting the digital image into first and second signals that substantially comprise the digital image channel, 

said first and second signals each characterized by image pixel values corresponding to the image pixels; 

(b) receiving an image pixel value of the first signal from a spatial region of the digital image; 

(c) receiving a tone scale function; 
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(d) calculating a statistical parameter based on the values of other pixels of the first signal in the spatial region 
of the digital image; 

(e) generating a scaling function based upon the statistical parameter; 

(f) generating a first intermediate value from the image pixel value and the scaling function; 

(g) generating a second intermediate value from the first intermediate value and the tone scale function; 

(h) generating an enhanced pixel value from an inverse of the scaling function and the second intermediate 
value; 

(i) combining the first signal with the enhanced pixel value and the second signal to generate an enhanced 
digital image channel. 

11 . The method in which the first signal is a low pass signal and the second signal is a high pass signal. 

12. The method in which the first signal is a pedestal signal characteristic of edges in the digital image channel 
and the second signal is a texture signal characteristic of texture in the digital image channel. 

13. The method in which the second signal is modified before it is combined with the first signal. 

14. The method further comprising the step of repeating the steps of receiving an image pixel value of the first 
signal from a spatial region of the digital image and of calculating a statistical parameter based on the values of 
other pixels of the first signal in the spatial region of the digital image, of generating a scaling function based upon 
the statistical parameter, of generating a first intermediate value from the image pixel value and the scaling function, 
of generating a second intermediate value from the first intermediate value and the tone scale function, of gener- 
ating an enhanced pixel value from an inverse of the scaling function and the second intermediate value, and of 
combining the first signal with the enhanced pixel value and the second signal to generate an enhanced digital 
image channel in order to generate an enhanced pixel for each image pixel in the digital image channel. 

15. The method wherein the statistical parameter of the step of calculating a statistical parameter base don the 
values of other pixels of the first signal in the spatial region of the digital image is the maximum or minimum of the 
pixel values from the spatial region of the digital image channel. 

1 6. The method wherein the statistical parameter is used to normalize the tone scale function thereby generating 
a normalized tone scale function. 

1 7. The method wherein the statistical parameter is used to normalize the original pixel value creating a normalized 
pixel value. 

18. The method wherein the normalized pixel value is modified by the normalized tone scale function. 

19. The method wherein the tone scale function is a predetermined sigmoid function. 

20. The method wherein the tone scale function is a predetermined sigmoid function used for each pixel in the 
digital image. 

21 . The method wherein the tone scale function is a predetermined sigmoid function that is normalized to create 
a normalized sigmoid function. 

22. The method wherein the normalized pixel value is modified by the normalized sigmoid function. 

23. The method wherein the step of using a sigmoid function is further comprised of determining the standard 
deviation of the sigmoid function based upon the statistical parameters. 

24. A computer program product for enhancing a digital image channel comprised of a plurality of image pixels, 
said computer program product comprising: a computer readable storage medium having a computer program 
stored thereon for performing the steps of: 

(a) splitting the digital image channel into first and second signals that substantially comprise the digital image 
channel, said first and second signals each characterized by image values corresponding to the image pixels; 

(b) providing a predetermined tone scale conversion to enhance the digital image channel; 
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(c) providing image values from the first signal corresponding to image pixels from a region of the image: 

(d) identifying a statistical characteristic of the image pixels in the region; 

(e) normalizing the predetermined tone scale conversion for the statistical characteristic in order to generate 
a normalized tone scale conversion; 

(f) performing the normalized tone scale conversion on a central pixel of the region in order to generate a first 
signal with enhanced image values; and 

(g) combining the first signal with enhanced image values and the second signal to generate an enhanced 
digital image channel. 

25. The computer program product in which the first signal is a low pass signal and the second signal is a high 
pass signal. 

26 The computer program product in which the first signal is a pedestal signal characteristic of edges in the digital 
image channel and the second signal is a texture signal characteristic of texture in the digital image channel. 

27. The computer program product in which the second signal is modified before it is combined with the first signal. 

28 The computer program product in which the region of the step of providing image values from the first signal 
corresponding to image pixels from a region of the image comprises providing image pixels from a two dimensional 
region distributed around the central pixel. 

29 The computer program product in which the region of the step of providing image values from the first signal 
corresponding to image pixels from a region of the image comprises a 5 X 5 or smaller array of image pixels. 

30. The computer program product in which the step of identifying a statistical characteristic of the image pixels 
in the region comprises determining a gradient value within the region. 

31 . The computer program product in which the gradient value is derived from a maximum and a minimum value 
for the region. 

32. The computer program product in which the gradient value is computed from the difference between maximum 
and minimum image values of image pixels within the region. 

33 The computer program product in which the gradient value is computed from the difference between average 
maximum and minimum values across respective pluralities of image pixels comprising portions of the region. 

34 The computer program product in which the step of providing a predetermined tone scale conversion to enhance 
the digital image channel includes the application of a predetermined tone scale function, the step of normalizing 
the predetermined tone scale conversion for the statistical characteristic in order to generate a normalized tone 
scale conversion comprises normalizing the value of the central image pixel input to the tone scale function with 
a scaling function based on the statistical characteristic, and the step of performing the normalized tone scale 
conversion on a central pixel of the region in order to generate a first signal with enhanced image values comprises 
mapping the scaled value of the central pixel through the tone scale function to generate an intermediate output 
value. 

35 The computer program product In which the step of performing the normalized tone scale conversion on a 
central pixel of the region in orderto generate a first signal with enhanced image values further compnses process- 
ing the intermediate value of the central Image pixel output from the tone scale function with a function that is the 
inverse of the scaling function. 

36 Thecomputerprogramproductinwhichthestepofprovidingapredeterminedtonescaleconversiontoenhance 
the digital image channel includes the application of a predetermined tonescale function and the step of normalizing 
the predetermined tone scale conversion for the statistical characteristic In order to generate a normalized tone 
scale conversion comprises normalizing the coordinates of the tone scale function based on the statistical char- 
acteristic. 

37 Thecomputerprogram product in which the step of providing a predetermined tone scale conversion to enhance 
the digital image channel includes application of a predetermined tone scale function, and the method further 
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comprises the step of adjusting a parameter of the tone scale function based on the statistical characteristic of the 
region. 

38. The computer program product in which the step of adjusting a parameter of the tone scale function comprises 
varying the slope of the tone scale function. 

39. The computer program product in which the steps of providing image values from the first signal corresponding 
to image pixels from a region of the image, of identifying a statistical characteristic of the image pixels in the region, 
of normalizing the predetermined tone scale conversion for the statistical characteristic in orderto generate a 
normalized tone scale conversion, and of performing the normalized tone scale conversion on a central pixel of 
the region in order to generate a first signal with enhanced image values are repeated for consecutive overlapping 
regions such that contiguous central pixels are processed through the tone scale conversion. 

40. The computer program product wherein the steps of normalizing the predetermined tone scale conversion for 
the statistical characteristic in order to generate a normalized tone scale conversion and of performing the nor- 
malized tone scale conversion on a central pixel of the region in order to generate a first signal with enhanced 
image values include application of a predetermined tone scale function to all central image pixels processed 
through the normalized tone scale conversion. 

41 . The computer program product in which the step of providing a predetermined tone scale conversion to enhance 
the digital image channel includes the application of a predetermined tone scale function having input and output 
coordinates, the step of normalizing the predetermined tone scale conversion for the statistical characteristic in 
orderto generate a normalized tone scale conversion comprises normalizing the input coordinate of the tone scale 
function with a scaling function based on the statistical characteristic and normalizing the value of the central pixel 
output from the tone scale function based on the inverse of the scaling function, and then the step of performing 
the normalized tone scale conversion on a central pixels of the region in order to generate a first signal with en- 
hanced image values comprises mapping the value of the central pixel through the tone scale function to generate 
a scaled output pixel. 

42. The computer program product in which the step of providing a predetermined tone scale conversion to enhance 
the digital image channel includes the application of a predetermined tone scale function having input and output 
coordinates, the step of normalizing the predetermined tone scale conversion for the statistical characteristic in 
order to generate a normalized tone scale conversion comprises normalizing the value of the central pixel input 
to the tone scale function with a scaling function based on the statistical characteristic and normalizing the output 
coordinate of the tone scale function based on the inverse of the scaling function, and then the step of performing 
the normalized tone scale conversion on a central pixels of the region in order to generate a first signal with en- 
hanced image values comprises mapping the scaled value of the central pixel through the tone scale function to 
generate a processed output pixel. 



Claims 
1 



A method for enhancing a digital image channel comprised of a plurality of image pixels, said method comprisinq 
the steps of: 

(a) splitting the digital image channel into first and second signals that substantially comprise the digital image 
channel, said first and second signals each characterized by image values corresponding to the image pixels; 

(b) providing a predetermined tone scale conversion to enhance the digital image channel; 

(c) providing image values from the first signal corresponding to image pixels from a region of the image: 

(d) identifying a statistical characteristic of the image pixels in the region; 

(e) normalizing the predetermined tone scale conversion for the statistical characteristic in orderto generate 
a normalized tone scale conversion; ^ 

(f) performing the normalized tone scale conversion on a central pixel of the region in order to generate a first 
signal with enhanced image values; and 

(g) combining the first signal with enhanced image values and the second signal to generate an enhanced 
digital image channel. 

2. The method of claim 1 in which the first signal is a low pass signal and the second signal is a high pass signal. 
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3. The method of claim 1 in which the first signal is a pedestal signal characteristic of edges in the digital image 
channel and the second signal is a texture signal characteristic of texture in the digital image channel. 

4. The method of claim 1 in which the second signal is modified before it is combined with the first signal. 

5. The method of claim 1 in which the region of step (c) comprises providing image pixels from a two dimensional 
region distributed around the central pixel. 

6. The method of claim 1 in which step (d) comprises determining a gradient value within the region. 

7. The method of claim 6 in which the gradient value is derived from a maximum and a minimum value for the region. 

8. The method of claim 7 in which the gradient value is computed from the difference between maximum and minimum 
image values of image pixels within the region. 

9. The method of claim 6 in which the gradient value is computed from the difference between average maximum 
and minimum values across respective pluralities of image pixels comprising portions of the region. 

10. The method of claim 1 in which step (b) includes the application of a predetermined tone scale function, step (e) 
20 comprises normalizing the value of the central image pixel input to the tone scale function with a scaling function 

based on the statistical characteristic, and step (f) comprises mapping the scaled value of the central pixel through 
the tone scale function to generate an intermediate output value. 
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